Feat: Integrate Request in parallel system (#32) #34

KonsumGandalf · 2024-01-07T12:24:48Z

Integrate system which throttles the request proccessed per second.
Hereby all schedulers share a pool of max requests per second which they can not overload, except the DeadlineSchedulerm which is always able to execute as much as it needs.

Tasks:

Integrate Endpoint to set the max number of requests
Integrate the requests into the sharedNexus
Integrate system into BulkScheduler and DeadlineScheduler

Additional Task:

Add Github pipeline

Add test script to simulate all tests at once and adjust set up script

Add nexus config

Add endpoint to set nexus config, integrate function to set max parallel executed pops

Reorder lines

Integrate system which prevents scheduler to run more function in parallel than allowed

Correct lint issues.

Add linting.

build pipeline

adjust clock

pkg/nexus/bulk/scheduler/bulk-scheduler.go

pkg/nexus/common/utils/helper-functions_test.go

pkg/nexus/nexus/nexus-router.go

Add functionality to call removing bulk items

Use utility function to do requests

Remove visual mode

Use base route and make nexus-config -> config

Fix lint issue

Improve scheduler logic

Routes issue

host issue

KonsumGandalf added 9 commits January 7, 2024 12:11

build(profaastinate): deployment, tests

066b2a2

Add test script to simulate all tests at once and adjust set up script

feat(pkg-nexus): config

753c64b

Add nexus config

feat(pkg-nexus): nexus

66acf51

Add endpoint to set nexus config, integrate function to set max parallel executed pops

style(pkg-nexus): deadline scheduler

9dbee55

Reorder lines

feat(pkg-nexus): bulk scheduler

460c534

Integrate system which prevents scheduler to run more function in parallel than allowed

refactor(pkg-nexus): common, nexus

3fcbd0b

Correct lint issues.

test(profaastinate): unit-test

2c31d6e

Add linting.

build: update dependencies

2a6eda8

feat(github): add github ci cd pipeline

2537e29

github-actions bot added go/modules ci labels Jan 7, 2024

KonsumGandalf added 9 commits January 7, 2024 13:29

build(github): github ci cd

136ba71

build pipeline

build(github): github ci cd

a7f125a

build pipeline

build(github): github ci cd

43e4c41

build pipeline

build(github): github ci cd

ab538fb

build pipeline

build(github): github ci cd

e81944b

build pipeline

build(github): github ci cd

d0cc9ec

build pipeline

test(pkg-nexus): deadline

242d64c

adjust clock

test(pkg-nexus): deadline

799e7b3

adjust clock

test(pkg-nexus): deadline

8453e27

adjust clock

This was linked to issues Jan 7, 2024

Integrate Github Test and Lint Action #35

Open

Integrate Request in parallel system #32

Open